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of concern to the cognitive scfentist Is the distortion and. omission In 
recall of material that was processed and understood. People are not tape 
recprderss or video tape recorders. A model of language comprehension 
which stores a representation of the meaning of an Input and then regurgf- 
tates It In toto Is not a model of human language comprehension, although 
It might be a model of superhuman language comprehension. Our models need 
to reflect what humans actually do do, not what superhumans might do. 

At least within the computer simulation community, the dominating 
concept in natural language comprehension work today is the concept of a 
^'frame'* (Hfnsky, 1975; Charnlak, 1975; Winograd, 1975). Other researchers 
have v^orked on related, al though .sametlmes rather different notions such 
as "scripts^' (Schank £ Abelson, 1975; Sehank et aK, 1975)* and "schemata" 
(Bobrow & Norman, 1975; Norman, 1975; Rumelhart, 1975; and Rumelhart $ 
Ortony, 1975). 

Frames, or "schemat^i'- as we shall call themv are Interacting structural 
*repres en tat Ions of domains o^ knowledge. Their purpose is to represent 
the general knowladge required to comprehend language and to provide the 
bases for interpreting incoming information. The Idea is that Incoming 
information will suggest schemata in a predomi nantl y bottom^up fashion 
until good candidates are established. While this happensj top-down pro*- 
cesses contribute to the further selection of schemata for subsequent pro- 
cessfng. An important feature of schemata is that they permit easy Infer- 
ences to be made about certain unstated aspects of an Input. Thusj for 
eKamples if (I) is encountered 

(I) John went to get some things at the supermarket 
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the ''supermarket'* schema will contsin information about baskets, thus en- 
abling the Inference that John put his purchases in a basket to be mad^. 
In linguistrcs thrs bringing to the fore of relevant selected fnformatfon 
has been caned ■'foregrounding" and st is discussed at length by Chafe (1972), 

There is no doubt that the general notion of schemata Is a useful one. 
!t clearly provides a representation of knowledge which permits the collection 
of pertinent relationships and concepts together, but theorists have tended 
to regard schemata as a panacea, often treating them as an alternative to 
other representational suggestions such as semantic networks or demons. 
To some extent this latter claim is an exaggeration. Winograd (197^)* for 
axample, suggests the possibility that such a representational system could 
be combined with others to provide the necessary richness. But few seem 
to have paid much attention to this kind of proposaK 

It is one of the purposes of this paper to suggest that the amphasis 
has been in the wrong direction* Schema^based conception*^' of ^he organ iza^ 
tion of memory concentrate too much on the nature of concepts In ?7iemory^ 
rather than on the nature of memory overall. Wa will argue that the best 
candidate for representing the overall structurs Is still the semantic net- 
.work, and the best candidate process to operate on It Is spreading activation. 

In their recent modification and Improvement of the Quill Ian (1968) 
network model of semantic memory, Collins and Loftus (1975) Introduce some 
addirlonal processing assumptions. The first is that when a concept Is 
processed activation spreads from it In a decreasing gradient; the second 
is that release of QCtivation from a concept continues at least as long 
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as that Goncept i& processed; and a third relaces to decrease of activation 
over time. The fDurth addition is that activation from different sources 
suimata and that there Is a threshold which determines whether or not an 
intersection is found. Added to these are two additional structural features, 
Ffrstg that semantic similarity plays a larger role in the organization of 
the network, and second that the names of concepts? i.e. wordSj are stored 
In a lexical network which is to some extent independently ''primeable J' 

Suppose we change the first assumption to a "restrain ing'- prfnclples 
namely^ that ff a concept does not receive sufficient activation to exceed 
its threshold, then ft does not transmit activation to neighboring concepts. 
Suppose further that each node is a unit naiie for a concept which is Itself 
a schema .with an internal structure * We would then have two levels of 
associations* The first level would be between""COncept connections, a net"- 
work representing memory as a whole. The second level would be within- 
concept connections^ representing the conceptuai relations inherent in 
individual concepts or schemata. 

The between-concept connections are those traditionally represented In 
semantic networks. For example, as Collins and Loftus represent it, part 
of the network might contain connections between the nodes for, say, ''fire- 
engine'* and those for "ambulance," "car," "truck," "bus," "f i re," "red," 
-ate. By contrast, the wi th in^concept connections are rather different. 
Thus, for example, the schema for "fire-engine'^ would probably not contain 
references to all the concepts related to it in the semantic network. 
Rather it would be a minl-network representing general knowledge about 

6 
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fire-engines. It would represent the knowledge that they were fast»moving 
road vehicles, that they carried aqulpment and people for fire-fighting, 
that they carried ladders and hoses, and that they make a great deal of 
noise, etc. The wi th in=concept , schema-based representations are thus 
much more highly structured, not representing more-or-less arbitrary connec- 
tjons between concepts, but representing the actual relationships between 
those concepts required to represent knowledge about the particular domain. 

With this kind of representation, there are two distinct ways of getting 
from one concept to a token representation of another. One can move between 
concepts by simple association, thus, for example, getting from "fire-engine'' 
to "ambulance, Or one can move within a concept and get from **fi re-engine" 
to, say, "hoseJ' In some cases, it is reasonable to suppose that one can 
get to a concept by both be^ween-concept associations and wi th In-concept 
associations, "fire-engine'' to "red" might be an example. 

Since schema theorists generally suppose that individual schemata 
can be regarded as the nodes in a network, the suggestions above may appear 
to add little to what is already a fairly standard approach. There are, 
however, some important differences. One is that some of the connecting 
links between concepts will be simple association Ijpks, while others are 
the labeled relations that participate in a particular schema. Some, but 
not all, of the labeled links are also simple associative links. But, 
more important than this. Is the fact that spreading activation need not 
operate upon the whole network (La. both within and between concepts) 
but in the first instance need operate only at the between-concept level. 
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The use of spreading activation will provide us with a basis for dis- 
tinguishing comprehension and memory^, particularly If this notion Is coupled 
wfth a distinction between episodic and ssmantic memory, 

Comprehens Ion and , Memor y 

In order to distinguish comprehension and memory one of the first 
tools we will require is the episodic/semantic merrory distinction. The 
distinction between episodic and semantic memory as envisaged by Tulving 
(1972) is a pretheoret ical one, one to assist In theory construction. He 
Indicates certain characteristics that each might havei episodic memory 
is autobfographicah It 'contains spat lotemporal information about expe- 
rienced events^ and It Incorporates perceptual Information; semantic memory 
is a mental thesaurus, Epfsodic memory, In its representation of expe-^ 
rienced episodes^ represents these episodes In an idiosyncratic way* It 
does so. as It were, In a way that is close to the way in which the stimulus 
was subjectively experlanced. This will become more clear as we proceed. 
While a distlnetton between episodic and semantic memory Is now fairly well 
accepted In psychology^ It has met with some res I stance In Artificial 
Intel Ifgence (Al) circles; Schank (1975) has explicitly argued against 
it. 

it IS now widely acknowledged that comprehension Involves the. utiliza- 
tion of knowledge. Memory, on the other handp Involves the retrieval , 
recognition^ and in some cases even the regeneration of representations of 
knowledge. In both Gomprehens ion and memory, the knowledge involved can 
be ei ther semant Ic or episodic. Suppose that when we read a sentence (or 

8 0- 

ERIC 



Reniambering and Understendfng 



8 



perceive an event), bottom-gp processes initiate a spread of aetlvation In 
the semantic network* There Is prasumably a context In which the input= Is 
encounterad and this context will Itself give rise to activation of a set 
of concepts. So, the context together with the Input win set up a pattern 
of activationj spreading from all those nodes whose thresholds are exceeded* 
The rastraining princfple suggested earlier, contributes to the prevention 
of an indiscriminate spread to every node In the network. Given no further 
input; the number of activated nodes will reach a maximum and start to 
decline. The subgraph formed by that subset of nodes activated, we call 
the final activated subgraph » for it represents the subgraph of the semantic 
network whichf in containing the greatest number of activated concapts, 
represents the best final list of concepts Involved in processing the input* 
Each concept in the final activated subgraph has an excitation level greater 



than or equal to Its threshold, and each permits access to Its correiponding 
schema for deeper processing and Inference > 

The spread of activation through the network Is one of the crucial 
components in comprehension* It serves to restrict the size; and content 
of the search set for the top-down employment of schemata* ft is a context^ 
sensitive process, since It produces a different f Inal^actlvated subgraph 
for the same Input under different contextual conditions, and it permits 
of different levels of processing (see Cralk & Lockhart, 1972) Insofar as 
the size of the finals-activated subgraph can be "artificially'* varied* 
Different levels of proceislng can also be attained by engaging In more 
or less inference, which Is achieved to a great extent by processing at 
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the level of schemata rather than at the between^concept , semantic network, 
level. Taking this approach, the process of comprehension involves activa- 
ting concepts related to those^ of the input and the contexts and engaging 
in infarences based primarily on those concepts. Put this way, it becomes 
clear that comprehension is a process prior to, and distinct from, the 
creation of a memorial representation. 

The generation of an episodic representation in memory clearly has to 
take advantage of the concepts employed In the comprehension process, and in 
order Fo do thiSf it would appear necessary to propose episodic represanta- 

tions that are rather more compleK in structure than past research has been 

i 

willing to allow* In particular, this suggests a tripartite organization 
of epfsodic representations, an organization which Includes surface struc^ 
ture, semantic representation, and input associates. The proposal is that 
an episodic representation is generated as a concept centered around the 
theme or topic* The representation would Include the final activated sub- 
graph by Including tokens of all its concepts* These tokens would allow 
access between the episodic representation and knowledge in semantic^ memory 
which is either related to the episodic representation Itself, or to its 
compohents* It would get built up in short term memory and then entered 
Into episodic memory as a record of the experienced meaning of the Input. 

Such a proposal for tripartite episodic representations has a number 
of Interesting features, particularly if a decay function Is associated 
with each component of the representation* One such feature concerns the 
relationship between the surface structure and the semantic representitlon. 

10 
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"DlTaTlsno^-the-^emant which were not explicit in the 
surface structure are normally determined with the help of concepts in the 
final activated subgrapht and this In turn depends for Its particular 
character on the context in which the input was encountered. Thus, If the 
surface structure is temporarily stored but tnadequately processeds as 
might happen when one hears but doesn't "register'' what someone says, a 

rei nterpretat ton based on the surface structure alone may give rise to a 

I 

slightly different episodic representation* Thus* the semantic representa- 
tlonj which can be thought of as an Instantiated schema, rnay have different 
values for some of the variables whose values were inferred* 

Whereas it can happen that occasionally a represantat Ion of surface 
structure survives without the other two parts which constitute an episodic 
representat lon^ normally the situation is the other way round. That is* 
the decay functions associated with each level of representation are such 
that the surface structure is lost flrsti the semantic representation secondt 
and the final activated subgraph last* At each decaying level, the con- 
stituents may themselves be decaying at different rates, so that not all 
constituents of all levels are equally available at differe times* Each 
level j however^ provides some reconstructive potential for the more 
rapidly decaying level next to It, Thus, If the surface structure has 
decayed the semantic representation provides the possibility of reconstruc- 
ting It in whole or in parti although more often than not* this reconstruc* 
tion results in a paraphrase rather than a verbatim recall. More interesting 
however, is what happens If details have been lost from the second level, 

11 
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the semantic representation. If, for axample, the value assigned to e ■ 
particular variable has decayed, the bottom level provides a list of eandidate 
concepts for regenerating or reconstructing the semantic representation- 
Later, it will transpire that this is the way in which one can account for 
errors, omissions and intrustons in recall. This reconstructive potential, 
however, Is not perfect since the conteKtuai details, while influencing the 
final activated subgraph, are not explicitly stored in the top level of 
surface structure representation. So, If one can remember a speaker^s 
exact words (surface structure), one can generally remember (or at least 
reconstruct) how it was interpreted and, consequently, at least some of. the 
associated concepts* However, one may have forgotten the surface structure 
and still have a representation of the semantic structure, or even lost 
that but still have some associated concepts left. The associations repre^ 
sented by the. final activated subgraph must be represented because they 
are in part determined by the total context in which the Input originally 
occurred; this is how encoding specificity can be handled (Tulvlng 6 Thomson, 
1973)- Notice that so far nothing has gone Into semantic memory; semantic ' 
memory has merely been invoked In getting episodic representations 
bui 1 t up. 

On the view being proposed, the knowledge structures stored in semantic 
memory are for practical purposes relatively permanent; over time they may 
undergo changes, but semantic memory is basically a repository for encyclo- 
pedic knowledge. Episodic memory, on the other hand. Is memory for the kind 
of Information one might Incorporate In a personal diary (cf, Ortony* 1975). 

12 
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Howeveri ft fs more than a record of personal experiences. It Is also the - 
source of knowledge for semantic memoryi provided that the necessary pro^ 
cessing 'takes place before too much of the episodic represehtat ton is/'lost* 
The contents of episodic memory Impose* certain restrictions on the way 
that knowledge can be represerited* For the sake of s Jmpl lei ty* let us, 
for the moment, restrict our discussion to knowledge represented proposf - 
t tonal ly, ' 

Semantic memory represents knowledge that a person believes to be true. 
While it is derived from experience^ it is a record of what he knows 
independently of experience- Episodic memory contains this knowledge 
embedded in source and modality information but it cannot be inferred 
directly from it, A simple example^ I read a book that claimed that X 
might be represented as part of the contents of one entry in episodic 
memory* here represents some arbitrary prbposltion* A normal person 
satisfied that he wasn't deliided would probably easily move to A book 
claimed that X » and that: might or might not be entered into semantic memory 
depending on the relevance of the book to what Is already known. But the 
putative knowledge is X^* stripped^ of source and circumstances, and a 
complicated, time^consumtng process of evaluation may be required before 
a person would be willing to assent to X^ alone. If time Is available, and 
relevance and potential use in inference seem to justify it, the evaluation 
may be undertaken and, 4f-_X can stand alone, it may be transferred to seman"" 
tic memory alone. Jhe evaluation required to get from A book claimed that X 
to X^ is a form of inference. ^So, we have a situation in which the 
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compr^ehenslon of an Inp^t item depends on accessing Information in seirantfc 

memory so as to enable the construction of a representatloa In episodic 

memory. The; putative knowledge In episodic memory (the % in A book claimed 

that X) can subsequently be freed for semantic memory If It Is sufficiently 

relevant and if sufficient subjective truth can be accorded to it. These 

evaluative processes^ of course, need not be conscious* 

/ \ ' ; ■ [ ^ 

A Re"- Inta rp retat ion of ^Some Data 

■ . / ; ' 

. An^ associative model of the kind Just outlined appears to be capable 
of distinguishing between comprehension effects and memory effects. Although 
current fashion in cognitive psychology tends to be rather unsympathetic 
towards associative models, It may be that assoclat ion Ism in general has 
been confused with particular associative theories, or pieces of them (e*g., 
Anderson S Bower^ 1973; Collins & Qui 11 Ian, 1969)* If this Js indeed true, 
then it Is necessary to show that some of the eKperimental results often 
cited as good reasons for rejecting associative accounts need to be re^ 
examined. The experiments I have chosen to look at are two that were con- 
ducted in our own laboratory, 

Ortony and Anderson (1977) constructed a number of sentence sets in 
which a noun phrase, either a name or a definite description, was paired 
with One of two predicates, F^/^ example, one of the sentence sets that was 
used was* j 

(2) The In^^entsr^^^-dyrraml te had a profound effect on the nature 
of warfare,' . . ' 

^ ^ (3) Alf red 'Robe I had a prdT6unT^efrecT1"onnfF^^ 

(k) The inventor of dynamite wore a fine beard,., 

(5) Alfred Nobel wore a fine beard,,. 
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Each subject in the aKperfment saw two seritenees from each set. In 

■ ■ \ , . ^ • . ; • 

i,tha aMample above, a subject wou>d see either (2) and (5) , or (3) and (4), 
and he was then asked to write a contfnuatfon pf'the sentence with the word 
*^but,*^ The purpose of the task was to encourage the subject to tfr^hk cara-. 
fully about the meantng of the sentencet After the subject had worked 
through the list he was given a recognition task In which all the sentences 
from all sentence sefes were shown to him. His task was to determine for 
each sentencfe whether^! t was a new sentence (one which he had not seen ~ 
earlier) or an old one (which he had)* The primary purpose of the'experr^ 
men t was to investigate the relationship between names and descriptions^---- 
and between them and different kinds of predicates* This was done by 
analyzing the recognition errors subjects made. Our prediction was that If 
a subject saw a pair such, as (2) and (5) he would be less likely to falsely 
recognize (3) and (4) since the^ f I rst * (2) , Is about the inventor of dynamite 
and can be judged and undarstobd Irrespective of w^o he was, and the second, 
(5)* concerns the personal characteristics of a particular man. This we 
felt was not true with sentences (3) and {k) ^ where. It was felt/ a subject 
might have Implicitly substituted, or at least have accessed, the name of 
the described Individual in C^) , and a suitable description of the named 
individual In (3)* These predictions were confirmed* 

One of the implications of this eKperimenti as with Anderson and Ortony . 
(1975) to be discussed shortly, Is that the noun phrases .Jn subject position 
in these sentences cannot be appropriately Interpreted until the predicate 
that follow%them has been processed, THe context that the predicate supplies 
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guides and conitrafns the interpretation of the noun phrase. Thii result, 
it seemSp' is one that can be well handled by a spreading activation model 
,of the kind proposed in this paper. • 

Assuming only /hat semantic memory contains, or can generate the concep^^ 
of the inventor of dynamite , when it is encountered, activation will begin to 
spread to adjacent nodes, not only to jjiventor and dynami te , but perhaps 
also to explosion , gunpowder , war , genius , scientist and so on. While this 
activation is taking place the predicate begins to get processid* If the 
predicate is had a profound effect on the nature of warfars , we might eKpect 
activation from the predicate, or concepts within It, of such concepts, as 
war , guns , death , etq,, but not of genius and scientist ; the result would, 
be that concepts in the war^ domain would have their activation Increased = 
while there would be ho support for the gen I us , sclent is4'- concepts Vwhose 
activation levels might ^thus be expected to fall off. Hence the probab,! 1 f ty 
of creating an activated subgraph containing war concepts would be much 
higher than that of a subgraph comprising concepts about smart scientistSt 
But, if the second predicate is encountered, the predicate wore a fine 
beard , concepts in the domain of people would be activated-f concepts perhaps 
including man , sc{entlst ,\ genius , eccentric and so on. In/this case we 



have activated both war concepts and people concepts and the resulting 
activated subgraph is more In doubt^-^it might contain waX^ concepts only, 

. . - ■ ; ■ ■ ' r 

people concepts only, or both* In any case, there will clearly be more 
activation of the war concepts given the war predicate, /than there will be 
_^lLVe:rL ,t he be r d p r ad i c a t_e beci iu se t _la tt a r can co^ t r i b_ u te v ! r tuft U y 
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nothing* Whether or not the subject knows the Identity of the Inventor 
of dynamitt Is not a critical question eKcept to the extent that if he doein^t 
there is no chance that It ^an get activated at any otage during the compre*- 
hanifon process. If he does know it, and even If It ddes get activated 
during the process, !t doesn-t make any difference unless it remalhs activa- 
ted at the end of the process and Is part of the final act ivated subgraph. 
This brings us to the question of the strength of the association. It Is 
presumably the case that George Washington Is much more 1 Ikely to be activated 
by The first Presiden t of the United States than \ s Christian Barnfard by 
The first man to do a heart transplant . Nevertheless, which nodes fall 
below threshold will also depend on the degree of connectivity in iemantic 
memory* Consequently The inventor of*^ dynamit e might ^be Just as stable {I.e., 
unlikely to fall below threshold) when related to the concepts derived from 
the war predicate as Alfred Nobel would. bCi everu If Alfred Nobel were very 
strongly associated with the conceptual structure deriving from the descrip^ 
tion* SOi a network model could explain these results in terms of differing 
combinations of the various activated concepts. Notice that we use the notion 
of "intersection** but not of "Intersection search." An "Intersection" Is 
merely a concept activated from two or more sources. Its effect Is to boost 
that concept - s^ level of activation and consequently the probability that It 
exceeds threshold and thus activates concepts related to Jt. . 

Anderson and Ortony (1975) had subjects learn two sentences from each 
of fourteen sentence sets. For example^- one of the sentence sets usedu^si 
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(S) Nurses are often bMutffuK 

(7) Nurses have to be licensed* 

{8) Landscipes are often beautiful. 

(9) Taverns have to be llcenied* 



Eich subject was asked to learn "^two from each set; fn this eKample, a 
subje^ct would have learned either (6) and (9), or (7) and^ (8). If he had 

, seen this latter palr^ th^n of the two retrieval eues ACTRESS and DOCTOR^ 
which he later received In a memory test, DOCTOR was regarded as the close 

\^ cue; and ACTRESS as the remote cue for his target sentence NursW^ have to be 
licensed . The landscape sentence acted as a control r What was found was 
a pattern such that\i)OCTOR would be a superior cue for Nurses have to be 
1 Fcensed , but . that ACTRESS would be superior for Nurses are often beautiful . 
The cues were not efferctfve by virtue of their association with efither the 
subject alone or the predicate alone. Doctor Was not effective by virtue 
of its connection with 1 Icenslnp because It never pllcfted the control 
sentence, Taverns have to be licensed, and had Its effectiveness been due 
to its connection with Nurse then It should have been equally good at 
eliciting both of the nurse sentences. The conclusion, therefore, was that 
the effectiveness of the close cue was due to Its relation to a meaning 
for the entire sentence^ rather than anyofi the Individual parts, alone. 

These results can be accounted for In exactly the same way as for 
Or tony and Anderson (1977). If both activated, Nurse s and License are, 
going to activate health professional and doctor with a greater probability 

— and-^-a-^reater— degree-than^ 
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more iikely to a .concept in the final activated subgraph than Is actress. 
Actress on the other hand. Is closer to woman which Is perhaps a better 
candidate f^^r final activation than dpctor starting from nurse and beautiful . 

A retrieval cue Is no more than a stimulus which is semantical ly and/or 
.experiential iW related to a record of an earlier atlmulus. If we could 
assume that the final activated subgraph stayed In memo ryN for some time 
without losing its Integrity, then all a cue would need to dp would be td 
reactivate or make contact with son.e part of the subgraph. ; Cd^slder the ..word 
ACTRESS in its relation to nursws ara often beautiful .-. There ark two 
posslbil itiesr the concept either does or does flot appear in the: final 
activated subgraph. If ft does not, we can be fairly sure that woman does , 
because it wi l l have received icti vat Ion from both subject and predicate. 
In this case, /the cue ACTRESS will activate the actress concept which in ' 
turn will lead to activation on neighboring nodes such as woman If the 
activation of woman I s'^suff Iciently Iricreased by actress , then the entire 
subgraph could i,ncrease its overall level of activation' giving rise to 
subsequent retrieval' of the subgraph. If the subgraph was not dense the 
additional activation of woman might give only partial retrieval of that 
subgraph. It Is clear that the sameWifid of pbcess would lead to recall 
in the case where the cue was itself A concept which was in the final 
activated subgraph, or where the cue wis any non-1 ingulit ic Input (such as 



aplcture) which made eventual contact through Its concept(s) with'a concept 
in the original . 

How do episodic and . samant ic memory comblnfes^to enable a subject using 
a retrieval cue such as ACTRESS to retrieve from TeplsodfcT memory^ ^RursSr ""^ 
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are often beautiful more rallably than Nursei have to be licensed? The cue 

activates the concept actresi In semantic memory which In turn activates^ 

let us ssvs woman and beautiful ^ The subject^ being told that he has to*^ 

recall the recently learned sentencei, has other Information ayallablei 

source and circumstance Information which together with the activated cbn-f 

cepts in semantic memory, should allow access to a repreientatlon In epiiodfc 

memory producad during the acquliit ton stage of the experiment. The subject 

then salacts that riipresentat ion in episodic memory with the most of his 

currently actlyated concepts represented In It. There are several ways in 

which he can go wrong. Firsts some of the associated concepts In the 

episodic representation might have atrophied. Seeondj the activated concepts . 

may not be unique to one episodic memory representation, in which case the 

subject will retrieve thp correct response only some of the time.' Thus, 

we can accoun.CAfor the kindtf of responses a subject might make. We can 

even account for gutesses and no response at all. In the first case thera 

could be too few of the associates in the episodic memory representation. 

In the ^second case there could be. nones due to inadequate processing at 

comprebeni ion' time. In both^ cases no unique episodic representation would 

be accessible. . . 

■ ^ ^ . , ' . ■ ^ # • 

Representing Text . v ' 

So far we have pretty much restricted our account to the comprehension 

and memory of individual sentences. But most langLfige processing that 

people do involves linguistic units of much greater length and complexity 

than ind ivi dual sentences. Whereas the sentence Is a fairly standard unlf = 
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of linguistic analysii, it probably does hot have any partleuTarty Important 
psyehological status as such. With Inputs iufffciehtly iKort to /enable the 
CQnitruction of a wel H Integrated final activated subgraph, the entlra massag 
Is represented* On the other hand, as the unit of input becomes longer^ 

there would probably be a problem of maintaining activation of all the rale- 

-_ - ■ . _____ . _ _^_____ _^-__' J 

vant concepts for a sufficient length of time* if a reader does not attempt 

to break such a message down Into more manageable '^chunks," corresponding to 

smaller, better Integratpd subgraphs, the chances are that some of the 

Important concepts Involved in comprehension will be lost* The construction 

of several related episodic representations to help in the representation 

of a compjex or a long message leads to the Idea that such messages will 

have to be represented In higher level structures* We might consider how 

thts could work with the individual units combining to give a representation 

of a passage of text* One possibility Is through some kind of chaining 

process* Such a process would allow ap event-based representation of the' 

total meaning bf the passage to be buflt up in episodic memory. 

Each Input unit (sentence or whatever) produces^ as we have seen, a 

final activated subgraph In semantic memory- The representation In episodic 

memory incorporates tokens of, or pointers to, these activated concepts. 

The meaning of the entire passage would be cumulatively constructed by 

generating connected episodic representations of psycholog leal! y discrete 

.components* Each unit that Is processed produces a pattern of activation 

whlcji Is In part determined by the pattern resulting from the last processed 

unit* If there is a dramatic change of subject. It Is to be expected that 
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the existing pattern of act fvation wl 1 1 not produce many intersections so 
that recently activatad nodes will rapidly l^ose their activation while a 
new Set becomes activated. A further feature Is that the final activated 
subgraph critically depends on each constituent (and Its order) which went! 
Into its making. At the same time It need contain no distinguishable ■ ■ 



representation of each of those constltueVitSi It has been built up througK 
an Interaction batween, the Input and the effect of the context (Including 
previously processed input) on semantic memory, Jt at once contains mori 
and less than the original passage^ a desirable feature slhca at an anec'dotal 

level, at leasts it accords with our daily experiences In reading text./ 

■ ■ - ■ ■ ■ ■ ^ I' 

At the same time, the semantic structure part of the representation will 

grow when the topic Is the same; but will not provide suitable points of 
attachment for radically new material, ^ ' 

In reading a passage^ the reader picks up clues as to the structurevof 
the input from his knowledge of syntax aided by the punctuatfon. In Ifs- 
tening, these cl ues are provided by prosodic features of the utterance. 
Without such clues^ a language processor has no basis for chunking the input 
into psycholqgical ly discrete units for processing. We can assume, , there- 
fore, that In normal cIrcumstanceSi a human language processor, can identify 
units to be processed as units, at various levels of structure. As he reads^ 
a passage, each unit provides a potential sefianjtja^structure^^ T^^^ / 
the next unit can be-absbrbedT and each unit provides a pattern of activa- 
tion (or a conteKt) for the current unit to' influence. Since people do . 
not remember passages word for word, we have to assume that the surface 
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structure of each unit fs not normally stored. Further, by building onto 
existing semantic representations, the overall order m.which J^^^rfginal 
units were proceised may not necessarfiy be represented. Sometimes, when 
order Is important, special strategies may result in the establishment of 
independent (but selected) episodic representations. Such a model, one 
in which there is no distinct representation for the meaning of individual 
constituent Inputs outside of the larger context (in this case the passage) 
in which they occur, accords well with the findings of Bransford and Franks 
(1971) and Spiro (1975) which Indicate that subjects do Incorporate In-^ 
, coming informat Ion into a whole in such a way that meaning components can 
be extracted but which makes it difficult to reliably Isolate individual j 
i^nputs. . , ^ 

When we read a sentence what we **get out of ft" is not a simple function 
of the concepts whose tokens occurred In it*^ We g^t a complicated representa, 
tion which may to a greater or lesser extent involve al I kinds of additional 
associated concepts. Yet when we think about or talk about that sentence, 
we seem to be able to operate on a more condensed comprehensive representa- 
tiorv. The same is true of the relationship that these condensed versions 
bear to the reprasen'tatlon of a 1 text* Our more superficial, 

1 mast detailed representation of a paragraph or a novel does not contain 
al^l the concepts which all the tokens In It activated; Indeed, It does not 
contain aJJ^ the condensed representations of It> individual units. . Some-^ 
thing new and riiore succinct is created/ I have a reasonably good repre^ 
sentation of Crime and Punishment , an entire novel, but It Is not a 
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conglomerate of all the concepts and their ^ssociatei that were activated 
while reading it. My representation U too vsgue and skimpy for that. 
I know that It was about a man (Raskblnlkov) and his actions (a hatchet 
Job on an ^ innocent old lady) and his subsequent Qmotlons in deal}ng with 
a police inspector who knew Raskolnikov had committed the crime but who 
couldn't prove it. 

On the model here being proposed^ a noyel would be represented as a ^ 
connected cluster of episodic representations, perhaps all connected to a node 
for It, say, "Crime and Punishment," The number of episodic representa- 
tlons need not be very large, especially after a long time. These con- 
stituent episodes each contain some .remnants of their final activated sub- 

* graphs, but many of the values for particular variables within them may 
have been lost (for example, the name of the inipector, or the old lady). 
The overall representation of the novel also contains Its own final activated . 
subgraph, ~ 

Both at the level of sentences, and at that of text, the kind of- 
episodic representations that /have been proposed permit of a reasonable 

account of distortions and omissions In recall. As was suggested earlier, 
the level s^w^ thin an episodrc representation a Mow communication between 



—them^ ye further suggested^hat a rate of decay is associated with each 
level, very fast for the top, surface structure level, and less fast for 
the lower levels. At the lower levels we probably need-to think in terms' 

: / . ^ ■ ^ ■ - 

■ . / ■ -■ , ^ 

of a differential decay rate for the individual concepts Involved. If I 
tell you today that my dog is sick, and two weeks later you politely Inquire 
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as to the health of my ailing cat, we need ,to be able to account for your 
misconception. The structure we have attributed to epiiodic representa- 
tjons permits us to deal with this kind of phenomenon. It is necesiary to 
asiume that the semantic structure component of the episodic representat Ion 
has in some way attrophled. In the particular example clted.s we have to \ 
assume that what has been lost Is the representation of \Wh^t was the 
particular cre^iura that was sick. What remalnr 1^ a structure repre- 
senting the Information that something or other belonging to the person 
who made the original utterance was sick. In reeall it Is therefore neces^ 
sary to reconstruct a representation of the or iglnal . . The record (or what v 
remains of It) of the final activated subgraph which constitutes pant of , 
the episodic representation provides a set of candidate concepts for j 
engaging in this reconstruct ive procesSp -Clearlyp these candidate concepts 
will have to be selected, presumabTy on the basis of Inferential processes. 
It Is beyond the scope gf this paper to speculate as to how these processes 
operate. The main pur^pose of Introducing the issue fs to suggest a way of ' 
accounting for Intrusions in recall. The ut 1 1 fzat Ion of a decaying repre-^ 
sentiation of a final, activated subgraph affords the possibility of producing 
recalls which utilize concepts different froms but related to* those which 
appeared In the original, • 

Concl us ion ' . 

We have seen how spreading activation operating on a semantic network 
can be used to distinguish what Is understood from an input; from what Is 
remembered of It. In doing so, we have po^stulated frame-1 ike entries, which 
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, ws have called sehamata as the basic units \n the networkt An it tractive 
addition would be to allow the spreading activation to also extend to 
repi^santatloni In epfsodtc memory, thus allowing entire experienced events 
to play the rote of associates^ to Inputs to and concepts In semantic membryt 
In: this way episodic representat Ions* or at least tokens of them^ would be 
able to feature as associates of later ones, thereby approKimat Ing more 
nearly to what we know happens to people * namely that episodic representa^ 
tlohs can relate to and be suggested by ^ not only general concepts (semantic 
- martiory) , but also by one another* Consequeritlyi we compensdted for the 
relative Informational poverty of semantic network theories while retaining.---'^ 
their power to selectively activate poncepts related to the Input taking 
Into acccunt the context in which it Is encountered* Concepts in memory 
are not to be regarded. as* structureless points but as richly structured 
representations. Even concepts which have been traditionally regarded as 
simple, unanalyzable properties, such as those designated by color tirms, 
have an internal structure* Halff, Ortony, and Anderson (1976) conducted 
a study Investigating the word *'redj' One of the eoncl usions of the study 
was that the Internal representation of a concept such as red has to be a 
real interval and cannot be a pointy as Implied by current models of seman- 
tic memory* V ^ 

It might seem philosophically heretical to suggest that there are no 
simple, unanalyzable properties, since, traditionally. In western thought 
there have been, and color terms were frequently taken as paradigmatic 
examples.^ Yet, we lose little if we relinquish this dogma* ^'Coficepts may 

■ . ' .. ■ , 26 ' /■ ' ■ ^ . 
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be more or less Structural ly complex without it being necessary that there 
be some ultimate, simple (therefore presumably structureless) concepts. 
Perhaps we should distinguish not between simple and complex, but between 
^complex and compound. The concept airplana we might say is compound in 
that it Incorporates other concepts; it is a compound complex concept. 
The concept of red or of warm might be regarded as a complex concept* but 
not a compound one. The structure of the concept might perhaps b^ regarded 
as some kind of distribution (see Anderson, 1975)* Certainly It Is straining 
the conventional sense of **simple'* to call such concepts simple. They may 
be relatively simple, they may even be unanalyzable, but certainly they are " 
not absolutely s imple, structural ly empty ^'things." Simple Ideas may bet. 
useful for philosophers, but are not, I suspect, for psychologists. 

In spite of the bad reputation that associatlonjsm has, ''pure** associa-^ 
tionism is innqcuousi indeed, in a sense It Is Imposstble to reject for It 
asserts only that ideas are related In a non-arbitrary way* To reject 
such a claim Is senseless and leaves one without even the basis for a 
theory* However, by making certain assumptions one can in fact eKplain a 
number of phenomena which critics of assoctatlonlsm have considered beyond 
theddomain of associative model. It is certainly not appropriate to try 
to explain all of cognition In this way, Assoc lat Ion iim constitutes a good 
model only of certain aspects of memory and understanding; but that Is only 
part of the story. Long-term memory comprises concepts of varying degress 
of complaxlty, related to one another by directed associative connections 
of various types. The totality of inputs to this network has various 
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short term and longer term effects. The short term effects include the 
excitation of a subgraph of related concepts, the long term effects Include 
the generation of new concepts , new connections between concepts, and changes 
in associative strengths, i.e, relative accessibility between concepts* 

A possible objection to such a system might be that It is too passive. 
But this Is not a serious problem, Firstlyp in It meanings are constructed — 
that Is, representations In episodic memory are created by reference to 
semantic memory and somet imes recreated or reconstructed for recall* It 
might be objected that all the relations In semantic memory are given and 
static* This is partly true, but It is not objectionable, for the detailed 
structure of memory Is forever changing, both with respect to content and 
with respect to strengths of associative links. Further, the relationships 
that are relevant between concepts will be largely determined by the con- 
tribution that context makes to activation levels In semantic memory. It 
might further be objected that the system is too S-R bound — that all that 
happens is an Inevitable result of the activation of some concept or 
concepts by an Input. It would then be argued that this leaves no room 
for a hypothesis/test strategy in perception or copprehens ion • The answer 
to these objections could be along the following lines* Whereas It is true 
that some of what happens is a direct result of activation by an input, 
it does not follow that It all Is. If every concept has a threshold it 
Is reasonable to suppose that some are lower than others. It is indeed 
the case that sometimes all that is needed is that the Input activates a 
concept-^such activation may even arrest other processing* Bobrow and 
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Norman (1975) consider the case of people so occupied with a task that they 
cannot ''hear" words directed to them. Yet, frequently, in thase situations, 
people do respond If their name Is spoken, or If the word fits into the 
context of their absorbing activity^ Our model readily accounts for this-" 
one*s own name Is connected to a lovi threshold concept (of self); words 
which fit the context provide additional activation to concepts already 
receiving some"-so less, If any, Is required to reach threshold* These 
cases of "perceiving without hearing" are precisely cases In which a certain 
amount of passivity is entirely appropriate In an explanation. The subjeot^ 
has no control over his sudden perception. It happens to him, he doesn't 
do it. But, there are some things that are not so simple. People can and 
do exercise some choice over what they are thinking about. Given tipat a 
person may have certafn goals, he may (rightly or wrongly) decide that he 
is more likely to achieve them by concentrating on one group of concepts 
rather than another. Such a choice may give rise to activation of one area 
of his network rather than another. Thinking may be partly the selective 
Increasing of activation in semantic memory or at least the temporary 
changing of thresholds. Passivity obviously is not the whole story. Con- 
cepts may em|Dody procedures or hypotheses; explorations In memory may test 
them, ^ 

Inevitably, more processes would have to be specified to properly 
characterize all the phenomena with which such a theory should be concerned, 
.Nevertheless, perhaps that old assoclat ion i st theory of memory has life In 
it yet* Ironical ly, its vagueness is at once Its power and Its weakness; 
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fts power because It can be shaped almost at will; Its weakness beeause 
unshaped or badly shaped ft fs vulnerable to criticism from every quarter- 
But at. least insofar as it seems capable of permitting a distlnctfon betwee 
memory and comprehension , it has much to ccmmend It. 
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